DAP3D-Net: Where, What and How Actions Occur in Videos?

Action parsing in videos with complex scenes is an interesting but challenging task in computer vision. In this paper, we propose a generic 3D convolutional neural network in a multi-task learning manner for effective Deep Action Parsing (DAP3D-Net) in videos. Particularly, in the training phase, action localization, classification and attributes learning can be jointly optimized on our appearancemotion data via DAP3D-Net. For an upcoming test video, we can describe each individual action in the video simultaneously as: Where the action occurs, What the action is and How the action is performed. To well demonstrate the effectiveness of the proposed DAP3D-Net, we also contribute a new Numerous-category Aligned Synthetic Action dataset, i.e., NASA, which consists of 200; 000 action clips of more than 300 categories and with 33 pre-defined action attributes in two hierarchical levels (i.e., low-level attributes of basic body part movements and high-level attributes related to action motion). We learn DAP3D-Net using the NASA dataset and then evaluate it on our collected Human Action Understanding (HAU) dataset. Experimental results show that our approach can accurately localize, categorize and describe multiple actions in realistic videos

Holographic Butterfly Effect at Quantum Critical Points

When the Lyapunov exponent $\lambda_L$ in a quantum chaotic system saturates the bound $\lambda_L\leqslant 2\pi k_BT$, it is proposed that this system has a holographic dual described by a gravity theory. In particular, the butterfly effect as a prominent phenomenon of chaos can ubiquitously exist in a black hole system characterized by a shockwave solution near the horizon. In this paper we propose that the butterfly velocity can be used to diagnose quantum phase transition (QPT) in holographic theories. We provide evidences for this proposal with an anisotropic holographic model exhibiting metal-insulator transitions (MIT), in which the derivatives of the butterfly velocity with respect to system parameters characterizes quantum critical points (QCP) with local extremes in zero temperature limit. We also point out that this proposal can be tested by experiments in the light of recent progress on the measurement of out-of-time-order correlation function (OTOC).Comment: 7 figures, 15 page

Robustness against adversarial attacks on deep neural networks

While deep neural networks have been successfully applied in several different domains, they exhibit vulnerabilities to artificially-crafted perturbations in data. Moreover, these perturbations have been shown to be transferable across different networks where the same perturbations can be transferred between different models. In response to this problem, many robust learning approaches have emerged. Adversarial training is regarded as a mainstream approach to enhance the robustness of deep neural networks with respect to norm-constrained perturbations. However, adversarial training requires a large number of perturbed examples (e.g., over 100,000 examples are required for MNIST dataset) trained on the deep neural networks before robustness can be considerably enhanced. This is problematic due to the large computational cost of obtaining attacks. Developing computationally effective approaches while retaining robustness against norm-constrained perturbations remains a challenge in the literature. In this research we present two novel robust training algorithms based on Monte-Carlo Tree Search (MCTS) [1] to enhance robustness under norm-constrained perturbations [2, 3]. The first algorithm searches potential candidates with Scale Invariant Feature Transform method and makes decisions with Monte-Carlo Tree Search method [2]. The second algorithm adopts Decision Tree Search method (DTS) to accelerate the search process while maintaining efficiency [3]. Our overarching objective is to provide computationally effective approaches that can be deployed to train deep neural networks robust against perturbations in data. We illustrate the robustness with these algorithms by studying the resistances to adversarial examples obtained in the context of the MNIST and CIFAR10 datasets. For MNIST, the results showed an average training efforts saving of 21.1\% when compared to Projected Gradient Descent (PGD) and 28.3\% when compared to Fast Gradient Sign Methods (FGSM). For CIFAR10, we obtained an average improvement of efficiency of 9.8\% compared to PGD and 13.8\% compared to FGSM. The results suggest that these two methods here introduced are not only robust to norm-constrained perturbations but also efficient during training. In regards to transferability of defences, our experiments [4] reveal that across different network architectures, across a variety of attack methods from white-box to black-box and across various datasets including MNIST and CIFAR10, our algorithms outperform other state-of-the-art methods, e.g., PGD and FGSM. Furthermore, the derived attacks and robust models obtained on our framework are reusable in the sense that the same norm-constrained perturbations can facilitate robust training across different networks. Lastly, we investigate the robustness of intra-technique and cross-technique transferability and the relations with different impact factors from adversarial strength to network capacity. The results suggest that known attacks on the resulting models are less transferable than those models trained by other state-of-the-art attack algorithms. Our results suggest that exploiting these tree search frameworks can result in significant improvements in the robustness of deep neural networks while saving computational cost on robust training. This paves the way for several future directions, both algorithmic and theoretical, as well as numerous applications to establish the robustness of deep neural networks with increasing trust and safety.Open Acces

Holographic Metal-Insulator Transition in Higher Derivative Gravity

We introduce a Weyl term into the Einstein-Maxwell-Axion theory in four dimensional spacetime. Up to the first order of the Weyl coupling parameter $\gamma$, we construct charged black brane solutions without translational invariance in a perturbative manner. Among all the holographic frameworks involving higher derivative gravity, we are the first to obtain metal-insulator transitions (MIT) when varying the system parameters at zero temperature. Furthermore, we study the holographic entanglement entropy (HEE) of strip geometry in this model and find that the second order derivative of HEE with respect to the axion parameter exhibits maximization behavior near quantum critical points (QCPs) of MIT. It testifies the conjecture in 1502.03661 and 1604.04857 that HEE itself or its derivatives can be used to diagnose quantum phase transition (QPT).Comment: 20 pages, 4 figures; typo corrected, added 3 references; minor revisio